On gradient adaptation with unit-norm constraints
نویسندگان
چکیده
{ In this correspondence, we describe gradient-based adaptive algorithms within parameter spaces that are speciied by jjwjj = 1, where jj jj is any vector norm. We provide several algorithm forms and relate them to true gradient procedures via their geometric structures. We also give algorithms that mitigate an inherent numerical instability for L 2-norm-constrained optimization tasks. Simulations showing the performance of the techniques for independent component analysis are provided. 0 Permission of the IEEE to publish this abstract separately is granted.
منابع مشابه
A Dual Modifier-Adaptation Approach for Real-Time Optimization
For good performance in practice, real-time optimization schemes need to be able to deal with the inevitable plant-model mismatch problem. Unlike the two-step schemes combining parameter estimation and optimization, the modifier-adaptation approach does not require the model parameters to be estimated on-line. Instead, it uses information regarding the constraints and selected gradients to impr...
متن کاملGradient descent of the frame potential
Unit norm tight frames provide Parseval-like decompositions of vectors in terms of possibly nonorthogonal collections of unit norm vectors. One way to prove the existence of unit norm tight frames is to characterize them as the minimizers of a particular energy functional, dubbed the frame potential. We consider this minimization problem from a numerical perspective. In particular, we discuss h...
متن کاملSimple Construction of a Frame which is $epsilon$-nearly Parseval and $epsilon$-nearly Unit Norm
In this paper, we will provide a simple method for starting with a given finite frame for an $n$-dimensional Hilbert space $mathcal{H}_n$ with nonzero elements and producing a frame which is $epsilon$-nearly Parseval and $epsilon$-nearly unit norm. Also, the concept of the $epsilon$-nearly equal frame operators for two given frames is presented. Moreover, we characterize all bounded invertible ...
متن کاملTwo Equivalent Presentations for the Norm of Weighted Spaces of Holomorphic Functions on the Upper Half-plane
Introduction In this paper, we intend to show that without any certain growth condition on the weight function, we always able to present a weighted sup-norm on the upper half plane in terms of weighted sup-norm on the unit disc and supremum of holomorphic functions on the certain lines in the upper half plane. Material and methods We use a certain transform between the unit dick and the uppe...
متن کاملGradient Flow of the Norm Squared of a Moment Map
We present a proof due to Duistermaat that the gradient flow of the norm squared of the moment map defines a deformation retract of the appropriate piece of the manifold onto the zero level set of the moment map. Duistermaat’s proof is an adaptation of Lojasiewicz’s argument for analytic functions to functions which are locally analytic.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- IEEE Trans. Signal Processing
دوره 48 شماره
صفحات -
تاریخ انتشار 2000